The Intrinsic Time Scale of Transient Neuronal Responses 
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In a generic neuron model, we present the linear response theory for the firing rate in response to both time 
dependent input currents and noise amplitudes. In both cases the signal transmission is strongly attenuated for 
frequencies above the stationary firing rate. For high frequencies both the mean input and the noise transmission 
function decay as u)~ 2 \ independent of model details. Our results indicate that previously suggested mechanisms 
for near instantaneous transmission of information are not consistent with the spike generation mechanism of 
real neurons. 
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In the brain information is processed through a hierarchy of 
neural layers. Based on the observation that human subjects 
can successfully distinguish complex visual stimuli in only 
a few hundred milliseconds it has been argued that the 
processing time of individual layers must be very small. Re- 
cently two different mechanisms have been proposed for the 
practically instantaneous relaying of information at the sin- 
gle neuron level. They utilize the fact that in vivo cortical 
neurons exhibit substantial subthreshold fluctuations of their 
membrane potentials, due to the large number of presynap- 
tic neurons |2|]. The first mechanism assumes that informa- 
tion is transferred by a time dependent noise amplitude 001, 
the second assumes information transfer via a modulation of 
the mean input in the presence of temporally correlated back- 
ground noise [lEl. These studies, which are based on a sem- 
inal work by Knight have been conducted on integrate- 
and-fire models. These models, however, are highly idealized 
models of cortical neurons. Their main ingredient is a fixed 
voltage threshold. Each time the membrane potential reaches 
this threshold, a spike is said to be emitted. Real neurons, 
however, as well as biophysically realistic conductance based 
neuron models do not have a fixed voltage threshold and are 
rather comparable to excitable systems. This naturally raises 
the question whether the response properties found in sim- 
ple threshold models are preserved if one considers models 
with a more realistic spike generating mechanisms. In this 
letter we address this question by a combination of analytical 
and numerical techniques considering a generic Type-I neuron 
model, the 6*-Neuron |9]. We show that in a realistic regime 
the response to a transient stimulus, both in the mean input 
as well as in the noise amplitude is not instantaneous as pre- 
dicted by the integrate-and-fire models. Moreover, we show 
that the maximum transmission frequency is approximately 
determined by the stationary firing rate. Thus our results sug- 
gest that the 0-Neuron reproduces the dynamical behavior of 
cortical neurons faithfully, while still being tractable analyti- 
cally. 



Neurons have been divided into several classes based on 
the kind of excitability they exhibit. In our study we focus on 
Type-I excitability which can be encountered in many neurons 
withing the cortex [8]. In models of Type-I neurons, repetitive 
firing typically emerges via a saddle-node bifurcation. The 
normal form of this bifurcation is equivalent to a phase os- 
cillator, the 0-Neuron [9]. It has been shown that it has the 
same mechanism of excitability and super-threshold behavior 
as cortical neurons fioll . Its dynamics is: 

t6 = (1 - cos0) + J(t)(l + cos 6>), 

where t is the time constant and I(t) represents the total 
synaptic input to the neuron. Each time the oscillator crosses 
the point 8 = it a spike is said to be "fired". For con- 
stant inputs this model exhibits a periodic firing regime for 
I > I c = with firing rate v = \fl / (7tt), and an excitable 
regime for / < 0. We analyze the response of an ensemble of 
such neurons, which is given by the ensemble averaged firing 
rate v(t). The input current I{t) is decomposed, 

I(t) = I + ay/rz(t), 

into a mean current Iq and a noise term which reflects the 
fluctuations induced by the synaptic inputs full . The noise is 
modeled by an Ornstein-Uhlenbeck process with a correlation 
time t c : 

dz 

t c — = -z + ri(t), 

where r\ (t) is Gaussian white noise. In the limit t c — > 0, z(t) 
becomes white noise. In the following, we have chosen the 
time constant r = 0.25ms which results in a spike duration 
of about 1ms as found in real neurons. Iq and a have been 
chosen to give realistic ^-correlation times of approximately 
10ms and firing rates in the range 1 — 20Hz. 

The state of an ensemble of such neurons is described by a 
probability density function P(6, z, t). Its dynamics is deter- 
mined by the Fokker-Planck equation: 
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dtP = LP, 
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with the operator, 

L = -r^de ((1 - cos( 
1 



+ (l + <tt 1/2 z} (1 + cos 6»)) 



periodic boundary conditions in the fi'-direction and natural 
boundary conditions in the z-direction. The firing rate v(t) is 
identical to the total probability current through the line 9 = 

tt: 



v(t) = 2t~ 



P(tt, z, t) dz. 



In the limit of temporally uncorrelated input, r c — > 0, the 
rate can be calculated analytically H 1 2l 1 1 311 which gives: 



4 I ' y 

dy exp<j -— f — +I Q y 



To investigate how the neuron responds to time dependent 
synaptic inputs it is important to consider both the response 
to a time dependent mean input current I = Iq + te tu}t + 
y/raz and a time dependent noise amplitude I = Iq + 
y/r (a + ee lu)t ) z. Inserting the modulated input current into 
Eq. Q and expanding P(9, z j t) = Po(&,z) + eP^ {9, z)e luJt + 
■ ■ ■ gives in linear order in e II 311 : 

iLuP LU (9,z) = LP LU -f(9,z), (2) 

with f(9,z) = — T~ l de(l+cos9)Po(9, z) for modulated input 
currents and f(0, z) = —T~ 1 / 2 de (1 + cos9) zP (9, z) for 
modulated noise amplitudes. The formal solution of eq. (0 
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e^ t - t "> t f(0,z)e iut ' dt'. (3) 



This integral can be solved in terms of eigenfunctions Pp. (9, z) 
of the operator L: 



X k P k (9,z)=LP k ( 



(4) 



with the associated eigenvalues X k . Because of the applied 
boundary conditions the spectrum {Afe} is discrete, and since 
detailed balance is not fulfilled, eigenvalues X k and the corre- 
sponding eigenfunctions P k (9, z) are either real or form com- 
plex conjugate pairs. Moreover, the eigenfunctions are typ- 
ically not orthogonal. However, an orthonormal set of ba- 
sis functions {|^fc)} can be constructed from them by Gram- 
Schmidt orthogonalization (in Dirac notation) with expansion 
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Inserting J2 k \<t>k 



1 into Eq. (0 yields, 
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c |/). The rate response is then given by: 



2t~ 



(P st (^z) + P w (7r,z)e^) dz 



= + ^i(^)e jM+0(w)) . 

The limit to — > oo can be treated analytically. Since f(9, z) 
vanishes at 9 = it, the modulus of P at this point has to be 
proportional to w -2 : 

(iu - i) PM, z)e- wt = -/(tt, z) = 0. 

An expansion in a; -1 reveals that the relative phase of v\(lo) 
is — tt in this limit. We would like to stress that this decay is 
universal and does not depend on model details. It is only due 
to the insensitivity to external inputs at the point where a spike 
is emitted, i.e. /(tt, z) = 0. 

The eigenvalues and eigenfunctions of the time- 
independent operator L determine vi(uo) completely. 
We computed them using a matrix representation of Eq. 
obtained by expanding P k (9,z) into a complete set of 
orthonormal functions: 
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Here H m (z) are the Hermite polynomials Q- In- 
serting this into Eq. @, multiplying from left with 

-1/2 



e m ' e H m ,(V2F c z)e- 



and inte- 



grating over the entire domain leads to the following eigen- 
value problem: 
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(5) 



Because the Fokker-Planck operator has only two Fourier 
components in the 0-direction and is polynomial in the z- 
direction, L is sparse with: 
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Ln,m;n' ,m' — 1 
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We solve Q numerically using the Arnoldi-method IU5I1 . a 
high performance iterative algorithm. Figure ^ shows the 
spectrum and the stationary density for two different corre- 
lation times t c together with the spectrum in the white noise 
limit. The eigenvalues are arranged in a series of wedges. The 
tip of each wedge is located at integer multiples of r" 1 . The 
different wedges account for the decay of excitations in the 
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z-direction, whereas the eigenvalues within a wedge account 
for the decay (real part) and oscillation (imaginary part) of ex- 
citations in the (^-direction. In the limit r c — > the spectrum 
exhibits only one wedge (open circles). For t c = 10ms (upper 
plot), the interaction between eigenvalues leads to deviations 
from the white noise limit only for strongly damped modes. 
The deviations become more pronounced only for large val- 
ues of r c = 50ms (lower plot). In both regimes the stationary 
density strongly deviates from a separable density. 
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Figure 2: Response amplitude (a,c) and phase (b,d) for a modula- 
tion in the input current (a,b) and in the noise amplitude (c,d). The 
different curves correspond to different values of vq (5, 10, 20Hz) 
and t c = 10ms. In the case of a modulated input current the am- 
plitude shows a maximum at approximately the stationary firing rate 
and decays then rapidly proportional to uj~ 2 (inset for uo = 20Hz, 
dashed: Lorentzian approximation). The relative phase lag drops 
from zero to — tv and shows a small dip at the resonance frequency. 
For a modulated noise amplitude there are more resonances at higher 
frequencies, but these are strongly damped. 



Figure 1: Spectrum of operator L (a,c) and stationary density (b,d) 
for T c = 10ms, vq — 10Hz (a,b) and r c = 50ms, uo = 8Hz (c,d) 
fnll . The open circles denote the result in the limit r c — > 0. In all 
cases a — 10 -3 , Io = 0. For increasing r c the tips of the wedges 
move closer to the imaginary axis. 

Examples of the response amplitude V\{uS) and the phase 
4>(oj) are depicted for different values of vq in Fig.|2]for both 
mean input and noise stimulation. In the case of mean in- 
put modulation, the linear response amplitude exhibits a reso- 
nance maximum at approximately the frequency of its station- 
ary firing rate and then decays rapidly to zero. The response 
phase starts at zero and then drops to — n. For a modulation 
in the noise amplitude the behavior is similar, except for addi- 
tional resonances at higher frequencies, which are, however, 
strongly damped. 

Whereas in general all eigenfunctions and eigenvalues con- 
tribute to the rate response, the relatively simple Lorentz-like 
shape of the response functions suggests that one frequency 
effectively dominates the neurons' behavior. We observed that 
this cut-off frequency is given by the imaginary part of the first 
excited eigenvalue of the first wedge for the current response, 
and by the corresponding eigenvalue of the second wedge for 
the noise response. This is demonstrated by the green dashed 
lines in Fig. [2] These are the sum of two Lorentzians with their 
maxima at the positive and negative frequency given by the 
imaginary part of the second eigenvalue in the corresponding 
wedge. The reason for this is apparent from for the decom- 
position of f(6, z) into eigenfunctions of the Fokker-Planck 



operator L: 

f(9,z) = Y,a l P l (9,z). 
i 

It has no contribution from the stationary density, since 
J f(0, z) d9 = 0, and for mean input modulations has a 
maximum contribution for the eigenfunctions corresponding 
to second eigenvalue in the first wedge. For noise modu- 
lations it has a maximum contribution for the eigenfunction 
corresponding to the second eigenvalue in the second wedge. 
The imaginary parts of the second eigenvalues in the first two 
wedges are, however, almost identical for the parameters used. 

The cut-off frequency for subthreshold mean inputs Iq < 
is depicted in Fig. [3] together with the dependence on the 
noise correlation time t c . The cut-off frequency increases for 
increasing values of Iq but always stays below the stationary 
rate vq. Increasing the noise correlation time at Iq = shifts 
the cut-off frequency to slightly larger values compared to vq. 

Thus our analysis demonstrates that in a realistic regime 
responses much faster than Uq are strongly damped, since 
the transmission function decays as ui~ 2 . We would like to 
conclude this letter with a comparison of the dynamic behav- 
ior of the 0-neuron with a biophysical realistic conductance 
based neuron 1 16] as well as with the classical leaky integrate- 
and-fire (LIF) model. Figure |4] shows the step response of 
the three models for an identical current correlation, identical 
initial and final firing rates and similar membrane potential 
correlation times. The dynamics of the 6>-neuron and the con- 
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Figure 3: Dependency of the cut-off frequency for different values of 
the stationary firing rate vq (20Hz(solid), lOHz(dashed), 5Hz(dash- 
dotted)) as a function of Jo (a) and as a function of the correlation 
time t c compared to the stationary firing rate (b). For increasing 
values of r c and la the cut-off frequency increases, but always stays 
below in- 



ductance based model agree well, their response time is about 
10ms. The dashed line shows the linear response result, which 
predicts a slower response but is of the same order of magni- 
tude. The LIF model on the other hand responds practically 
instantaneously. This is due to the fact that in the LIF model 
high input frequencies are not substantially damped, i.e. the 
response amplitude does not decay for large frequencies. This 
is impossible in the #-neuron in which the response amplitude 
always decays as lo~ 2 . We would like to stress that this decay 
is a universal property due to the insensitivity to input currents 
at the point where a spike is fired and is independent of model 
details. Thus, although one observes that the response times of 
both, the ^-neuron and the LIF model decrease with increasing 
t c , the mathematical origin and nature of this dependence is 
very different. Whereas in the 6>-neuron it is a consequence of 
the dependence of the eigenvalues on r c , in integrate- and-fire 
models they result from the voltage threshold. 

In conclusion, we presented the linear response theory for 
the firing rate of the #-neuron in response to both time de- 
pendent input currents and time dependent noise amplitudes. 
For an effective numerical treatment we derived a sparse ma- 
trix representation of the Fokker-Planck operator. Using the 
eigenvalues and eigenfunctions of this operator, we showed 
that the transmission amplitude is in both cases strongly 
damped for frequencies above a cut-off frequency. In a wide 
range of parameters this cut-off frequency is always below the 
mean firing rate. We showed that the response behavior agrees 
well with the dynamics of a conductance based model neuron 
and is different from the behavior of the LIF model. Our re- 
sults indicate that the 6>-neuron, although simple, captures well 
the dynamical properties of real neurons. They also reveal that 
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Figure 4: Comparison between the response of the #-neuron (a), a 
conductance based model (b) and the LIF model (c) to a voltage 
step. The model neurons are approximately at the onset of repeti- 
tive firing, comparable to neurons in vivo and receive an additional 
correlated input current with r c = 10ms. The correlation time of the 
membrane potential is approximately 16ms for the (9-neuron and the 
Wang-Buszaki neuron and approximately 10ms for the LIF neuron 
(parameters as in [6]). While the LIF neuron responds practically in- 
stantaneously, the response time of the 6-neuron and the conductance 
based model is about 10ms. (dashed: Linear response result). 



previously proposed mechanisms of practically instantaneous 
transmission of information are incompatible with the spike 
generating mechanism of real neurons. Our findings suggest 
that the f?-neuron reproduces the dynamical behavior of corti- 
cal neurons with Type-I excitability faithfully, while still be- 
ing tractable analytically. 
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